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With the help of quantum mechanics one can formulate a 
model of associative memory with optimal storage capacity. 
I generalize this model by introducing a parameter playing 
the role of an effective temperature. The corresponding ther- 
modynamics provides criteria to tune the efficiency of quan- 
tum pattern recognition. I show that the associative mem- 
ory undergoes a phase transition from a disordered, high- 
temperature phase with no correlation between input and 
output to an ordered, low-temperature phase with minimal 
input-output Hamming distance. 
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The power of quantum computation [Q is mostly asso- 
ciated with the speed-up in computing time it can pro- 
vide with respect to its classical counterpart. Recently, 
however, I showed that this new paradigm of infor- 
mation processing opens the possibility for another im- 
provement upon classical computation, represented by 
associative memories with exponential, and thus optimal, 
storage capacity. Subsequent further studies |^ are turn- 
ing quantum pattern recognition into a completely new 
application of quantum information theory. 

In traditional computers the storage of information is 
address-oriented. Retrieval of information requires a pre- 
cise knowledge of the memory address and, therefore, 
incomplete or noisy inputs are not permitted. In or- 
der to address this shortcoming, models of associative 
(or content-addressable) memories were introduced. 
Here, recall of information is possible on the basis of par- 
tial knowledge of their content, without knowing the stor- 
age location. The best known examples are the Hopfield 
model and its generalizations ||^. 

While these models solve the problem of recalling in- 
complete or noisy inputs, they suffer from a severe capac- 
ity shortage. Due to the phenomenon of crosstalk, which 
is essentially a manifestation of the spin glass transition 
in the corresponding spin system, the maximum num- 
ber of binary patterns that can be stored in a Hopfield 
network of n neurons is linear in the number of neurons, 
Pmax = 0{n) |]. 

The probabilistic associative quantum memory pro- 
posed in Q solves both problems. It is content- 
addressable and can thus recognize corrupted or incom- 
plete inputs and it can store 2" binary patterns on 
n qbits. Contrary to its classical counterpart, which 
matches any input onto a stored pattern, the quantum 
associative memory is characterized by both a recognition 



process and an identification process. An input pattern 
can be rejected as non-recognized even before an identi- 
fication is attempted. For its simplest version, described 
in the identification efficiency cannot be tuned; only 
the recognition efficiency can be influenced. 

In this paper I propose a generalization of my previ- 
ous model with a new parameter t playing the role of an 
effective temperature, which can be tuned by adding a 
number h — [l/i]intcgcr of certain control qbits. A proper 
thermodynamics corresponding to this parameter t can 
be defined. In particular, the free energy F[t) describes 
the average behaviour of the recognition mechanism at 
temperature t and provides criteria to tune the efficiency 
of the associative memory. I show that, by increasing h 
(lowering t), the associative memory undergoes a phase 
transition from a disordered phase with no correlation 
between input and output to an ordered phase with min- 
imal Hamming distance bcwteen the input and the out- 
put. This extends to quantum information theory the re- 
lation with Ising spin systems known in error-correcting 
codes and in public key cryptography[Q . 

The memory model proposed in consists of three 
registers: one for the input, one for the memory |m) 
proper and one for a control qbit |c). The memory \m) 
consists of a coherent superposition of the p binary pat- 
terns on n entangled qbits: 
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I do not discuss here the algorithm for generating this su- 
perposition starting from the n individual patterns, since 
it is described in detail in ||]. Also, the usual error- 
correcting infrastructure |^ is assumed in order to pro- 
tect the memory from decoherence. 

The information retrieval algorithm entails repeating 
a set of operations and measurements of the control qbit 
|c) until this is found in state |0) or a threshold T of 
repetitions is reached. When |c) = |0) is measured one 
can proceed to a measurement of the memory register 
that yields the output; if T is reached before obtaining 
|c) — |0) the input is classified as "non-recognized". 

I propose here to generalize this device by increasing 
to b the number of control qbits and repeating sequen- 
tially all operations for each of them before measuring the 
control register. The full initial quantum state is thus: 
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where \i) = \ii, ...,?„) denotes the input qbits, the sec- 
ond register, to, contains the memory and all b control 
qbits are in state |0). Applying the Hadamard gate |^] 
H = (cti + (T3) /-\/2 ((Ti being the Pauli matrices) to the 
first control qbit one obtains 

IV'i)=^ f]|z;/;Oi,...,0,) 
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+^ VK;/;1i,...,06 
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I now apply to this state the following combination of 
quantum gates: 

n 

IV'2) = n ^OT.-,^ XOi?,^„JVi) , (4) 

where the single-qbit gate NOT is represented by the 
first Pauli matrix cti, while the two-qbit exclusive OR 
(XOR) has the matrix representation XOR = diag(l,(Ti) 
and performs thus a NOT on the second qbit if and only 
if the first one is in state Subscripts indicate the 
qbits on which these gates are applied, m denoting the 
memory register. 

As a result of the above operation the memory register 
qbits are in state |1) if ij and are identical and |0) 
otherwise: 
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where d*^ = 1 if and only if ij — pj and dj = otherwise. 
Consider now the following Hamiltonian: 
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where (T3 is the third Pauli matrix. 7i measures the num- 
ber of O's in register to, with a plus sign if ci is in state 
|0) and a minus sign if ci is in state Given how I have 
prepared the state |'02) , this is nothing else than the num- 
ber of qbits which are different in the input and memory 
registers i and m. This quantity is called the Hamming 
distance and represents the (squared) Euclidean distance 
between two binary patterns. 

Every term in the superposition (||) is an eigenstate of 
Ti with a different eigenvalue. Applying thus the unitary 
operator exp(i7r7i/2n) to IV'2) one obtains 
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where du {hp'') denotes the Hamming distance bewteen 
the input i and the stored pattern p'' . 

In the final step I restore the memory gate to the state 
I to) by applying the inverse transformation to eq. (Q) 
and I apply the Hadamard gate to the control qbit ci, 
thereby obtaining 



1^4)= Ha, n XOR^^m, NOT,n, H^i 
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IV'4)= -^^cos —dn {i,p'') |i;p^0i,...,06) 

VP k=i 

1 ^ TT 

-h— ^sin ^du {i,p^) li, . . . , Ob). 

The idea is now to repeat the above operations sequen- 
tially for all b control qbits ci to c^. This gives 
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where {J' } denotes the set of all binary numbers of b bits 
with exactly I bits 1 and (b—l) bits 0. This concludes the 
deterministic part of the information retrieval process. 

At this point one needs a measurement of the control 
register. Note that the overall effect obtained by the 
deterministic operations is an overall amplitude concen- 
tration on memory states similar to the input if there 
is a large number of |0) control qbits and an amplitude 
concentration on states different to the input if there is a 
large number of |1) control qbits. One is thus interested 
in retaining the projected state after the measurement 
only if all control qbits are measured in state |0). This 
will generically entail repeating the deterministic part 
of the algorithm several times, until exactly the desired 
state for the control register is obtained. If the number 
of such repetitions exceeds a preset threshold T the in- 
put if classified as "non-recognized" and the algorithm 
is stopped. Otherwise, once |ci, . . . , Cb) = |0i, . . . , Ob) is 
obtained, one proceeds to a measurement of the mem- 
ory register to, which yields the output pattern of the 
memory. 

Since the expected number of repetitions needed to 
measure the desired control register state is with 
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the probability of measuring |ci, . . . , c„) ~ |0i, . . . , 0„), 
the threshold T governs the recognition efficiency of the 
input patterns. 
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Once the input pattern i is recognized, the measure- 
ment of the memory register yields the stored pattern p*^ 
with probabihty 



Pb {p^) = \ cos 



2b 



z=ppr = 



p 

E 

fe=i 



(11) 



(12) 



Clearly, this probability is peaked around those patterns 
which have the smallest Hamming distance to the input. 
The highest probability of retrieval is thus realized for 
that pattern which is most similar to the input.. 

Contrary to the simplest version of this model pre- 
sented in 1^, however, here there is a second tunable 
parameter, namely the number b of control qbits. This 
new parameter b controls the identification efficiency of 
the quantum memory since, increasing 6, the probability 
distribution Pt, (p'"') becomes more and more peaked on 

the low d-H {hP^) states, until hmf,_,oo Pb {p'') = <5fcfc„i„ , 
where fcmin is the index of the pattern (assumed unique 
for convenience) with the smallest Hamming distance to 
the input. 

The role of the parameter b becomes familiar upon 
a closer examination of eq.( |l^). Indeed, the quantum 
distribution described by this equation is equivalent to 
a canonical Boltzmann distribution with (dimensionless) 
temperature t — 1/b and (dimensionless) energy levels 



E^ = -2 log cos(— (z,/; 



(13) 



with Z playing the role of the partition function. 

The appearance of an effective thermal distribution 
suggests studying the average behaviour of quantum 
associative memories via the corresponding thermody- 
namic potentials. Before this can be done, however, one 
must deal with the different distributions of stored pat- 
terns characterizing each individual memory. To this end 
I propose to average also over this distribution, by keep- 
ing as a tunable parameter only the minimal Hamming 
distance d between the input and the stored patterns. 
In doing so, one obtains an average description of the 
average memory. 

As a first step it is useful to normalize the pattern rep- 
resentation by adding (modulo 2) to all patterns, input 
included, the input pattern i. This clearly preserves all 
Hamming distances and has the effect of normalizing the 
input to be the state with all qbits in state |0). The Ham- 
ming distance dn {i,P^) becomes thus simply the number 
of qbits in pattern with value |1). For loading factors 
p/n ^ in the limit n — > oo the partition function for 
the average memory takes a particularly simple form: 



{A} j=d 



(14) 



where \j describes an unconstrained probability distribu- 
tion such that Y^^=d ^3 ~ 1' i^} ^^*-li distri- 
butions and A'^;^ tne corresponding normalization factor. 



I now introduce the free energy F(b, d) by the usual 
definition 



Z,.=pe-™=Za.(6 = 0) e-^^M, 
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where I have chosen a normalization such that exp(— 6i^) 
describes the deviation of the partition function from 
its value for b ~ (high effective temperature). Since 
Z/p, and consequently also Z^-^jp posses a finite, non- 
vanishing large-n limit, this normalization ensures that 
F{b,d) is intensive, exactly like the energy levels (p^), 
and scales as a constant for large n. This is the only dif- 
ference with respect to the familiar situation in statistical 
mechanics. 

The free energy describes the equilibrium of the sys- 
tem at effective temperature t = 1/b and has the usual 
expression in terms of the internal energy U and the en- 
tropy S: 



F{t,d)^ U{t,d) -tS{t,d) , 
U{t,d)^{E)t, S{t,d)^- 



-dF{t, d) 
~~dt 



(16) 



Note that, with the normalization I have chosen in ([T^), 
the entropy S is always a negative quantity describing 
the deviation from its maximal value S'max = at i = oo. 

By inverting eq.(|l^) with F substituting E one can 
also define an effective (relative) input/output Hamming 
distance V at temperature t: 
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V^t, d) = — arccos e ^ 
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This corresponds exactly to representing the recognition 
probability of the average memory as 
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which can also be taken as the primary definition of the 
effective Hamming distance. 

The function I?(6, d) provides a complete description 
of the behaviour of quantum associative memories, which 
can be used to tune their performance. Indeed, suppose 
that one wants the memory to recognize and identify in- 
puts with up to en corrupted inputs with an efficiency 
oi v {0 < v < 1). Then one must choose a number b 
of control qbits sufficiently large that (I?(6, en) — e) < 
{1 — ly) and a threshold T of repetitions satisfying T > 
1/cos^'' (^I?(6, en)), as illustrated in Fig. 1 below. 

A first hint about the general behaviour of the effective 
distance function !?(&, d) can be obtained by examining 
closer the energy eigenvalues (p^. For small Hamming 
distance to the input these reduce to 
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Choosing again the normalization in which |«) |0 . . . 0) 
and introducing a "spin" s'^ with value = —1/2 if qbit 
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i in pattern p'' has value |0) and sf = +1/2 if qbit i 
in pattern p'^ has value |1), one can express the energy 
levels for dn /?i <C 1 as 



2 2 
^ J^Sr^ k k 

16 ■ 4n2 ^ ' J 



(20) 



Apart from a constant, this is the Hamiltonian of an 
infinite-range antiferromagnetic Ising model in presence 
of a magnetic field. The antiferromagnetic term favours 
configurations k with half the spins up and half down, so 
that Sjot = I]i = 0> giving E'' = Tr^/lG.The mag- 
netic field, however, tends to align the spins so that 
s'^tot — —n/2, giving i?*^ — 0. Since this is lower than 
TT^/IG, the ground state configuration is ferromagnetic, 
with all qbits having value |0). At very low tempera- 
ture (high 6), where the energy term dominates the free 
energy, one expects thus an ordered phase of the quan- 
tum associative memory with 2?(i, d) = d/n. This cor- 
responds to a perfect identification of the presented in- 
put. As the temperature is raised (6 decreased) however, 
the thermal energy embodied by the entropy term in the 
free energy begins to counteract the magnetic field. At 
very high temperatures (low b) the entropy approaches 
its maximal value S{t = oo) = (with the normalization 
chosen here). If this value is approached faster than 1/t, 
the free energy will again be dominated by the internal 
energy . In this case, however, this is not any more deter- 
mined by the ground state but rather equally distributed 
on all possible states, giving 
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Number b of control qbits 

FIG. 1. EflFective input/output distance and entropy 
(rescaled to [0,1]) for 1Mb patterns and d/n — 1%. 

The phase transition occurs at &cr — 10^^. The physi- 
cal regime of the quantum associative memory (6 = posi- 
tive integer) begins thus just above this transition. For a 
good accuracy of pattern recognition one should choose 
a temperature low enough to be well into the ordered 
phase. As is clear from Fig. 1, this can be achieved al- 
ready with a number of control qbits b = 0(10'*). Note 
that this number becomes independent of the dimension 
n of the patterns for large n. The computational load of 
quantum pattern recognition is thus determined uniquely 
by the accuracy requirements. 



and leading to an effective distance 



n 2 2 log2 d ^ fd^ 



(22) 



This value corresponds to a disordered phase with no 
correlation between input and output of the memory. 

A numerical study of the thermodynamic potentials in 
( p^ ) and ( p7| ) indeed confirms a phase transition from the 
ordered to the disordered phase as the effective temper- 
ature is raised. In Fig. 1 I show the effective distance 
V and the entropy S for 1 Mb (n = 8 x 10®) patterns 
and d/n = 1% as a function of the inverse temperature 
b (the entropy is rescaled to the interval [0,1] for ease of 
presentation). At high temperature there is indeed a dis- 
ordered phase with S — 5max = and V — 2/3. At low 
temperatures, instead, one is in the ordered phase with 
S = S'min and T> = d/n = 0.01. The effective Hamming 
distance plays thus the role of the order parameter for 
the phase transition. 
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